Quantum Metrology Assisted with Abstention 
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The main goal of quantum metrology is to obtain accurate values of physical parameters using 
quantum probes. In this context, we show that abstention, i.e., the possibility of getting an incon- 
clusive answer at readout, can drastically improve the measurement precision. We focus on phase 
estimation and quantify the required amount of abstention for a given precision. We also develop 
analytical tools to obtain the asymptotic behavior of the precision and required rate of abstention 
for arbitrary pure qubit states. 
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In its simplest form, a quantum metrology problem has 
the following structure. A quantum system undergoes 
some physical interaction determined by some continuous 
parameters. The value of the parameters gets imprinted 
onto the evolved state and the task of the metrologist 
consists in uncovering it. For this purpose, she performs 
a suitable measurement on the system and, based on its 
outcome, she produces a guess for the unknown value of 
the parameters as accurate as possible The overall 
performance of the whole procedure can be quantified 
by the average of a figure of merit (typically the fidelity) 
over some a priori distribution of the parameters and over 
all possible outcomes. Phase estimation with pure states 
of N qubits is a paradigmatic example of this endeavor 
and will serve as the main exemplification of our findings. 

In standard parameter estimation protocols 0-0] the 
experimentalist is expected to produce a conclusive an- 
swer (maybe not right or accurate enough) , at each run of 
the experiment. Here we show that there are situations 
where the ultimate precision of the standard approach 
can be improved substantially if one allows for a num- 
ber of inconclusive responses, where the metrologist ab- 
stains from producing a guess. This is especially relevant 
in situations where she can afford to re-run the experi- 
ment (i.e. she can easily prepare a new instance of the 
problem) or where she prioritises having high-quality es- 
timates. Abstention has already been used in the context 
of state discrimination 6-9], where some fixed rate Q of 
inconclusive outcomes can lower the probability of error 
significantly (even down to zero, as in unambiguous dis- 
crimination [6j) and can be seen as a particular example 
of post-selection jjjj . 

In the estimation framework the effects of abstention 
have hardly been considered. In the cases studied so far 
in the literature ll|, |l2| , abstention has limited impact 
for large samples unless the experimentalist refrains from 
producing an estimate most of the time. Here we show 
that there are relevant cases where abstention has a dra- 
matic effect. Though we focus on phase estimation, other 
problems, such as direction estimation, can be tackled in 
the same way (results will be given elsewhere [13|). 

In this letter, we also present a very general technique 
to obtain the asymptotic form of pure-state parameter 



estimation problems, with or without abstention. The 
main idea is that the components of the probe state can 
be viewed as a discretization of some continuous function 
ip(t) on the unit interval [0, 1], and the maximization of 
the fidelity as a constrained variational problem defined 
by a suitable action for (p(t), from which the solution can 
be worked out analytically in many physically relevant 
situations. It is worth mentioning that even in the stan- 
dard approach to estimation (without abstention) ana- 
lytical asymptotic expressions were known in just a few 
cases. 

In phase estimation, one aims to optimally esti- 
mate the parameter 9 of the covariant family of 
states {]*(#)) = I7(0)|*o)}ee[o,2,r), where U{9) stands 
for the unitary transformation U(8)\j) = e and 
l^o) is a normalized fiducial state that in the eigenbasis 
of U(9) can be written as |* ) - Ej=o c jli) G (<C 2 )® N . 
The fidelity between the true phase 9 and its estimate 9 X 
can be written as [1 + cos(9 — 9 x )]/2, where x is a sub- 
script specifying that the estimate is based on the out- 
come x °f a generalized measurement. This is character- 
ized mathematically by a positive operator valued mea- 
sure (POVM) n = {n x }U{n }, n + £ x n x = 1, where 
n x > outputs a conclusive answer (from which an esti- 
mate is proposed) and n > outputs 'abstention'. The 
probability of abstention taking place is 
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-<*(0)|n o |*(0)), (i) 

and Q = 1 — Q is the acceptance probability (rate at 
which we provide definite estimates) . The average fidelity 
for this rate of abstention is 
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Estimation with abstention can be reduced to a 
standard estimation problem by simply introducing 
the new POVM fl, with elements given by IL X = 
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This formulation brings forward an interpretation of 
the role of abstention here: each initial state \^(0)) is 
transformed into a new |vP(6*)) that 'encodes' the un- 
known parameter 9 in a more efficient way. This map 
improves the estimation precision by effectively increas- 
ing the distinguishability between the signal states, there- 
fore it can only be implemented in a probabilistic fashion 
(it succeeds with probability Q). This stochastic map 
is fully specified by the optimal choice of n , i.e., the 
one that maximizes ([2]). Although this may seem a dif- 
ficult optimization problem, a huge simplification arises 
because of the covariance of the family of states. Already 
from Eqs. (JI]) and (J2J one can easily see that the optimal 
POVM can be chosen to be covariant under the set of uni- 
taries {£/(#)}. In particular this means that IIo can be 
taken invariant under the transformations {U(0)}. Thus, 
using Shur's lemma one gets n = YV fj\j)(j\> an d the 
maximization is over {fj : < fj < l}jLo- Note that 
the transformed set of states {| '!'(£'))} is also a covariant 
family, just as the original one, with fiducial state 
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where fj = l- fj- 

Since the transformed states are still covariant, we can 
choose II to be the well known optimal continuous and co- 
variant POVM 0,1: {11(6) = U(d)\$)($\Ui (6)} ee[0 , 27r) , 

where |<I>) = EjLo li)- Hereafter it is assumed that the 
states have non-negative coefficients £j > (and hence 
c j > 0), for any phases present in the coefficients Cj 
(or £j) can be absorbed by the above POVM elements. 
With this, the calculation of the fidelity simplifies to 



(5) 



where in the eigenbasis of U(9) the matrix of M 
is real and tridiagonal, with elements My — 
(^ij+i +<5i.j-i) /2. The maximization over {fj} in (JSJ) 
can be turned into a maximization over the transformed 
states, A = max| e) (£|M|£) = max Kj) E^o* ob- 
ject to the constraints = I and £j < Xcj, where 
A = Q- 1 / 2 . Then, the maximum fidelity for a given rate 
of abstention Q is F(Q) = (1 + A)/2. 

For large enough abstention rates the inequality con- 
straint has no effect (provided Cj ^ 0, Vj) and A be- 
comes the maximum eigenvalue of the matrix M. In this 
case, F* = F(Q — > 1) is the maximum fidelity that can 
be achieved by optimizing the components of the fidu- 
cial state; these are given by the corresponding eigen- 
vector |r) of M From the inequality constraint we 
obtain the critical acceptance rate Q* = wmj(cj / £*) 2 . 
That is, for abstention rates such that Q > Q* = 1 — Q* 
the fidelity attains its absolute maximum value F* . 
In the other extreme, when no abstention is allowed 



(Q = 0), no maximization is possible, hence £j = Cj 
and A = (c|M|c). For intermediate values of Q e (0, Q*) 
the calculation becomes more tricky. For moderate values 
of N it can be easily cast as a semidefinite programming 
(SDP) problem (see Supplemental Material), and hence 
solved efficiently to arbitrary accuracy [14j . 

However, the main focus of this work is on asymptotics 
(large N regime) and in particular on presenting an ap- 
proach that enables obtaining analytical asymptotic ex- 
pressions. With this aim, let us define S = 1 — (£|M|£), 
where we further introduce Lagrange multipliers b 2 /2 for 
the normalization condition and Sj, j = 0, . . . , N for the 
inequality constraints £j < Xcj , also called primal feasi- 
bility conditions. We thus have to minimize 
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where the so-called dual feasibility conditions Sj > 0, and 
the complementary slackness conditions Sj (^- — Xcj) = 
must also be imposed, as dictate d by the Karush-Kuhn- 
Tucker (KKT) method (see e.g., (Tj). 

Rather than attempting to solve the above minimiza- 
tion, we will reframe it as a functional variational prob- 
lem by taking N to be asymptotically large. We first 
note that as N goes to infinity j/N approaches a con- 
tinuous real variable t. So, we define < t = j/N < 1, 
and assume and {cj} are a discretization of some 
continuous functions, ip(t) — £jVN and ip(t) = Cjy/N. 
Note that (p(t) > and ip(t) > 0, and the normalization 
condition f Q <p(t) 2 — f Q tp(t) 2 = 1 is satisfied. It follows 
that - ij ~ N~ 3 / 2 {d<p(t)/dt], and we can write © 
as the functional 



S[<p] = 



l p 2 (0) + V 2 (l) 
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where u — Nb > is the properly scaled Lagrange mul- 
tiplier and cr(t) is a function that interpolates the set 
of multipliers {sj}, i.e., Sj = N~ 5 / 2 a(t). With this, 
the following conditions must hold: ip(t) — Xip(t) < 
(primal feasibility), a it) > (dual feasibility), and 
a(t)[ip(t) — Xtpit)] = (complementary slackness). Note 
that by imposing the boundary conditions ip(0) = and 
ip(l) = 0, the functional S[<p] becomes 0(N~ 2 ). These 
conditions can be always met if Q > 0, while for Q = 
the asymptotic scaling of F is dominated by the first term 
of ©, of order N' 1 . 

More interestingly, the minimization of S[<p] defines a 
mechanical problem, of which the second line in Eq. ([7]) 
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is the 'action' and the corresponding integrant the 'La- 
grangian'. It describes a driven harmonic oscillator with 
angular frequency u>, whose 'equation of motion' is 



d 2 ip 2 



(8) 



To solve this problem, we first note that the slackness 
conditions imply that either </?(f) = Xip(t), in which 
case we say t is in the so called coincidence set C, or 
ait) = 0. In the second case, t £ C (the complement 
of 6), the primal feasibility condition is ip(t) < Xtp(t) 
and Eq. © becomes homogeneous. It has the familiar 
solution ip(t) — Asinujt + Bcosujt, where A, B and lj 
are constants to be determined. In C, a is given by ©, 
where we make the substitution ip(t) = Xip(t). If we 
restrict ourselves to fiducial states jvPo) whose compo- 
nents Cj are such that ip(t) is continuous in the whole 
unit interval, one can show that the solution ip(t) and its 
first derivative must be also continuous there [except in 
points of C where ip(t) itself is not differentiable] . Most 
of the physically relevant cases are of this type. By tak- 
ing into account the boundary conditions, as well as the 
'matching conditions', namely, continuity of tp(t) and its 
derivative in the boundaries of C, one can determine the 
arbitrary constants that arise in solving the equation of 
motion, which include the location of the boundaries of C. 
The minimum value of S for Q > can be expressed in 
terms of the Lagrange multiplier (function) u> (a), and 
the given function ?/), as 
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dt aip 
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Note that the integral is effectively over C, where a = 
X(d 2 ip j dt 2 +u! 2 ip) . In the following we solve some relevant 
cases, but we first compute the fidelity for arbitrary large 
rates of abstention, asuming Cj ^ 0, Vj. 

Large abstention: For abstention rates very close to 
one (large A), one has 6 = 0, and the above reduces 
to a maximum eigenvalue problem. The solution is 
tp(t) — V^sm-fl-i. This yields the asymptotic result 
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which coincides with the known maximum fidelity for 
optimal phase encoding 
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Phase states: The elements of this family are gener- 
ated by an equal superposition of all Fock states \j), 
cj = + 1 (hence proportional to the POVM seed 

state). The corresponding continuous version is ip(t) = 1. 
Without abstention, Q = (A = 1), the optimal phase 
estimation precision provided by these states does not ex- 
ceed the shot- noise limit: 1-F = \/{2N+2). For Q > 
(A > 1) the situation changes markedly. We can freely 
impose ip(0) — ip(l) = and get rid of the shot-noise type 
of term 1/7V in ([7]). In a sufficiently small neighbourhood 



of t = 0, we have ip(t) — A < 0, and hence a(t) = there. 
If a is the maximum value of t less than 1/2 for which this 
condition holds, it must be a boundary point of C. Then, 
for a < t < 1 /2 the solution is given by the rescaled in- 
put state ip(t) = Xtp(t) — A. Thus, tp(t) = Asinujt for 
t € [0,a) and ip(t) — A for t £ [a, 1/2]. Imposing the 
matching conditions we find a = 1 - 1/A 2 =Q, \<V% 
(i.e. Q* = 1/2), and 



2 sin 



< t < Q, 



irt 
2Q 

Q < t < 1/2. 



For 1/2 < t < 1 the solution follows from the obvious 
symmetry relation ip(t) = ip(l — t). We have C = [Q, Q] 
and a(t) = uj 2 X for t £ C. Therefore, Eq. (]9]) leads to 
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< 



< 



1/2, (12) 



and for 1/2 < Q < 1 we have F = F * in Eq-dTUJ). We 
note that even the slightest abstention rate unlocks the 
probing capabilities of the phase states and drastically 
changes the estimation precision from shot- noise (1/-/V) 
to Heisenberg (1/N 2 ) scaling. 

Multiple copies: These probe states have been widely 
considered in quantum metrology. They have the form 



|0)+e i9 |l) 
V2 



(13) 



and the coefficients of the corresponding fiducial state 
l^o) read Cj — 2~ N / 2 ( N ^~ 1 I 2 . Their maximum precision 
for Q = and large N is known to be 1-F = l/(4/V) [l~5j| . 

In the asymptotic limit the rescaled components V^V Cj 
approach the function 



N 



2nt(l - t) 



1/4 



.■M><J~ff(t||l/2n. i 14) 



where H(t || 1/2) = log 2 + tlogt + (1 - t) log(l - t) is 
the relative entropy between two Bernoulli distributions 
with success probabilities t and 1/2. The symmetry of 
the problem suggests using the variable r = i-l/2, re 
[—1/2, 1/2]. As a function of this new variable <p(t) must 
be even [we slightly abuse notation by writing (p(t(T)) in 
short as <p(r)], hence it must have the form 



A cos uj 
AV(r), 



< |t| < a, 
a<\r\< 1/2, 



(15) 



where as above u), a and A are determined by the match- 
ing and normalization conditions. The resulting equa- 
tions cannot be solved in full generality, however we will 
obtain analytical solutions in two relevant regimes. To 
this end, we note that in the region |r| < N~ x / 2 [i.e., 
around the peak at t = 1/2 of (|14|)] . i/j(t) behaves as the 
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FIG. 1. (Color online) (a) Plot of NS = 2N(1 - F) vs Q 
(solid line) for an asymptotically large number TV of parallel 
spins, Eq. I|13[l. The dots have been obtained by numerical 
optimization with TV = 100. (b) Profile of the transformed 
fiducial state |§ ) for A = 1.5 (Q = 0.56). The thin (thick) 
line corresponds to N = 20 (N — 80). The points are ob- 
tained by numerical optimization. The dashed lines represent 
the function Xtj)(t) that defines the primal feasibility condition 
ip(t) < Xip{t), where ip(t) is in (fTil) . 

Gaussian distribution iJ)(t)k,(2N /ir) 1 ' i e~ NT , whereas at 
the tails (|r| > TV -1 / 2 ) it falls off at an exponential rate 
lower bounded by H (1/2 + a || 1/2) /2. 

In the first regime, the abstention rate Q has a fixed 
non-zero value (independent of N). This requires that 
the boundary point a scales as the width of ip{r), i.e., 
a ~ TV -1 / 2 , thus V'( r ) is accurately given by its Gaussian 
approximation. This observation, along with a suitable 
rescaling of cj and A, enable us to obtain the solution in 
parametric form: (Q(£l), 5(f2)) (see Supplemental Mate- 
rial). In Fig. [I] (a) we plot NS = 2N(1-F) as a function 
of Q. Despite the strong dependence on the abstention 
rate, particularly at Q < 1, the precision will be shot- 
noise limited in the whole interval [0, 1). We see that, 
e.g., an abstention of about 90% has the same effect as 
doubling the number of copies in the standard approach, 
with Q — 0. Also, for vanishing abstention rate we re- 
cover the well known result 2iV(l — F) = 1/2. The exact 
(numerical) profile of the transformed state \^>o) is shown 
in Fig. [0(b), together with the analytical result ip(t), for 
an abstention rate of 56% and two different values of N 
of 20 and 80 copies. 

We next explore a second regime in which the Heisen- 
berg limit 1 - F ~ TV" 2 (i.e., S ~ iV~ 2 ) is attained. For 
that we need that the function tp(r) in (|15[) has a wide 
(non vanishing) support as N goes to infinity. This is 
easily accomplished by taking the boundary point a to 
be independent of AT. In this situation, once N is large 
enough, the coincidence set 6 lies on the tails of ip(r), 
where this function falls off exponentially at the domi- 
nant rate of H(l/2 + a || l/2)/2. Solving the matching 
and normalization conditions we obtain the fidelity: 

F = 1 -T6N^ + 0{N ~ 3) > 0<a ^ 1 ^ ( 16 ) 

and the acceptance rate: Q ~ exp{— NH(l/2 + a || 1/2)}. 
Thus, the Heisenberg limit scaling 1/iV 2 can be attained 



if such exponential rate of acceptance is affordable. Note 
that the critical acceptance rate is Q* — 2~ N (a — s- 1/2), 
below which F — F* . 

Although in this letter we have focused in phase es- 
timation, our methods directly apply to other problems 
such as direction estimation 1 1 31 ) . In this case one can de- 
fine the analogous of the phase states introduced above 
(fiducial state proportional to the seed of the correspond- 
ing optimal POVM). Our results nicely mirror those pre- 
sented here, the main difference being the replacement 
of the trigonometric functions by Bessel functions. For 
tensor product states of identical copies, abstention does 
not improve the estimation [12j . However, for antipar- 
allel product states where half of the spins point in one 
direction while the other half point in the opposite, ab- 
stention again gives raise to a change in the asymptotic 
behavior of the precision, from the original shot-noise 
(l-F ~ 1/N) to the Heisenberg (1-F ~ 1/A 2 ) scaling. 
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SUPPLEMENTAL MATERIAL 



function 



Semidefinite programming formulation 



The evaluation of 



A = max(£|M|0 
10 



(17) 



subject to = 1 and ^ < Acy, can be cast as a 

semidefinite programming (SDP) problem. One simply 
linearizes these constraints by introducing a SDP (posi- 
tive operator) variable B to play the role of | £)(£!■ The 
SDP form of flU) is then 



A 



max tr ( f 
B 



IB) 



subject to 



trB = l, B>0, 
Bjj < X 2 \c, 



A > 1. 



(18) 



(19) 



In order for the optimization problems (fl7|) and <p~8|) to be 
equivalent, we must prove that the optimal B is rank one. 
Proof: since all the entries of M are non-negative, tr(MB) 
increases with increasing values of the off-diagonal en- 
tries Bj J+ i. Their maximum value consistent with posi- 
tivity is given by rank one matrices. Therefore, the op- 
timal B is of the form 



tp(r) 




< |t| < a, 
a<\r\< 1/2, 



(21) 



[Eq. (15) in the main text)]. The matching conditions, 
i.e., the continuity of both <p(r) and <p'{t) at the bound- 
ary point t = a can be combined to obtain 



a 2 = 



ft tan ft 



A 2 



2N 

7T 



1/2 



A 2 e- 2a2 (4a 4 + r> 2 ) 
ft 2 ' 



(22) 



(23) 



where we have defined ft = w«. The normalization con- 
dition turns out to be 



<9 a(2ft + sin 2ft) 
1 = A 2 — — -+X 2 



2VNQ 



l-Erf(V2a)j, (24) 



where Erf(x) is the error function. Eq. (|24[) is correct 
up to exponentially vanishing contributions, which can 
be neglected here. In deriving this equation we also used 
that Erf ( y/W/2) -> 1 for large N. Substituting Eq. (J53J| 
in Eq. (fMf we obtain 

l= Er fc(V2a) + Q ( 4a4+ ^ +Sill2 ^e-^ (25) 
A- V27rft 3 



Shot-noise regime for multiple copies 

As explained in the main text, this regime requires that 
a ~ N^ 1 / 2 to ensure that the scaled components ^/Ncj 
of the fiducial estate |* ) = |*(0)), Eq. ([13]), can be 
approximated by the Gaussian distribution 



7T 



1/4 



,-JVt 



(20) 



at the boundary of 6. Asymptotically, the scaled com- 
ponents VN^j of the optimal |£) in (fTTj) approach the 

I 



where Erfc is the complementary error function, defined 
as Erfc(x) = 1 — Erf(x). Finally, with the help of the 
Gaussian approximation (1201) . we compute the minimum 
action, Eq. ©, and obtain 



S-- 



X 2 



2N 2 2N 2 



(U! — A^)Erfc(v / 2a) + 



ANa 

, t 

x/2^ 



-2a' 



(26) 



Eqs. (52} and (p5]l. along with w = flVN/a and Q = 
1 — 1 / A 2 , enable us to write all variables in terms of the 
single parameter ft. By further substituting in Eq. (|26|) 
we obtain the curve (Q, S) in parametric form: 



Q = Erf ( Vft tan ft - (ftsec 2 ft + tan ft) 



S ~ 2N 



tan ft 

Trft 



-O tan O 



tan 2 ft - ft (2ft - tan ft) sec 2 ft 



2 ft 2 sec 2 ft + %/tt ft tan ft Erfc ( Vfttanft ) e° tan 



(27) 
(28) 



This curve, which can be easily plot, is shown in function of Q cannot be found since that would involve 
Fig. [T] (a). An analytic expression of S as an explicit solving the non-trivial transcendental equation in (|27p. 



